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(54) METHOD AND DEVICE FOR REMOTE CONTROL 

(57)Abstract: 

PROBLEM TO BE SOLVED: To eliminate the possibility of nonconformity such as 
robot damage due to human operating errors by driving a device to be controlled 
on confirming an operating signal corresponding to the displayed contents of 
operations. 

SOLUTION: A voice database 14 outputs voice output data corresponding to an 
operation indicating signal for 'advance' to a voice synthesizing part 15and the 
voice that says 'Advance. Is there any obstacle?' is announced via a speaker 16. 
The operatorin response to this announcement and the turning on of an advance 
lamp 21 checks using a monitor 10 an image fed from a camera 6 to make sure that 
no obstacle is present aheadand pushes an advance switch 22 if there is no 
problem. When detecting an obstacle ahead in the image on the monitor 10the 
either performs no operations or pushes a retreat switch 24 or a reset switch 25. 



CLAIMS 



[Claim(s)] 

[Claim 1]Are the method of controlling the controls from remoteness and 
utterance of operation of said controls is changed into an audio signalA remote- 
control method driving said controls if those uttered contents of operation are 
recognizedthese recognized contents of operation are displayed and a manipulate 



signal corresponding to this operation label is checked. 
[Claim 2]A remote control comprising: 

Voice operation and a verifying means which recognizes the contents of operation 
of the controls with an input voice signaland outputs the contents of operation 
Two or more displaying means which display said contents of operation. 
A control means corresponding to these displaying means. 

A control means which drives said controls when a displaying means according to 
the contents of operation inputted from said voice operation and verifying means 
is chosen and displayed and said contents of operation and a manipulate signal 
from said control means are in agreement. 

[Claim 3]A function to choose and utter voice data corresponding to the contents 
of operation which are the remote controls according to claim 2and have been 
recognized to voice operation and a verifying means was added. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the remote-control method used 
for the controlssuch as a teleoperated robot having a means to prevent an 
operation mistakeand its device. 
[0002] 

[Description of the Prior Art]Conventionallythe teleoperated robot having a means 
to prevent an operation mistake is indicated by JP6-32587Afor example. 
[0003]Namelywhen it has the memory the prohibition operation to the present 
operation was remembered to be and there is a spoken command inputlf said 
memory is searchedit thinks from the present operation and it performedwhen 
there are voice input directions which may judge whether they are the voice input 
directions which may cause a dangerous situationand may cause a dangerous 
situationA robot is made to suspend and the industrial robot provided with the 
interlock (safety means) which prevents generating of the situation which is not 
preferred is indicated. 
[0004] 

[Problem(s) to be Solved by the Invention] however — the situationi.e.a situation 
without interlockwhere the prohibition operation to the present operation is not 
memorized even if it is the industrial robot provided with the above-mentioned 
interlock (safety means) — a robot — a dangerous state — ********** — there 
were things. For examplewhen an obstacle was ahead of a robot and directions of 
advance were inputted accidentallythe robot moved forwardwith the obstaclemight 
collide and might be damaged. 

[0005]Thenan object of this invention is to provide the remote-control method 
which cancels faultssuch as breakage of the robot by human being's failureand its 



device. 
[0006] 

[Means for Solving the Problem]In order to attain the purpose mentioned 
aboveamong this inventions the invention according to claim 1 Are the method of 
controlling the controls from remoteness and utterance of operation of said 
controls is changed into an audio signalSaid controls will be drivenif those uttered 
contents of operation are recognizedthese recognized contents of operation are 
displayed and a manipulate signal corresponding to this operation label is checked. 
[0007]With a described methodonly when utterance and a manipulate signal of 
operation of the controls are in agreementthe controls drive. Thus2 stagewise 
operation is performedthe coincidence is checkedand when the controls drive 
after thata drive of the controls by an operation mistake is prevented. 
[0008]claim 2 written this invention is characterized by it having been alike and 
comprising the following. 

Voice operation and a verifying means which recognizes the contents of operation 
of the controls with an input voice signaland outputs the contents of operation 
Two or more displaying means which display said contents of operation. 
A control means corresponding to these displaying means. 

A control means which drives said controls when a displaying means according to 
the contents of operation inputted from said voice operation and verifying means 
is chosen and displayed and said contents of operation and a manipulate signal 
from said control means are in agreement. 

[0009]Herea displaying means and a control means comprise an illumination switch 
(push button switch with a lamp)for example. According to the above-mentioned 
compositionin voice operation and a verifying meansthe contents of operation are 
recognized by utterance of operation of the controls from the input voice 
signaland it is outputted to a control meansA control means chooses and displays 
a displaying means according to the inputted contents of operationand when said 
contents of operation and a manipulate signal from a control means are in 
agreements drives said controls. Thus2 stagewise operation is performedthe 
coincidence is checkedand when the controls drive after thata drive of the 
controls by an operation mistake is prevented. 

[0010]The invention according to claim 3 added a function to choose and utter 
voice data corresponding to the contents of operation which are inventions given 
in above-mentioned claim 2and have been recognized to voice operation and a 
verifying means. 

[001 1]According to the above-mentioned compositionin voice operation and a 
verifying meansthe contents of operation are recognized by utterance of operation 
of the controlsand voice data corresponding to the contents of operation is 
chosen and uttered from the input voice signal. As this utterancean announcement 
to which visual recognition is urgedfor example is performedand a control means is 
operated according to this announcement. That is2nd operation is performed. And 
said controls are driven when said contents of operation and a manipulate signal 



from a control means are in agreement. Thus2 stagewise operation is 
performedthe coincidence is checkedand when the controls drive after thata drive 
of the controls by an operation mistake is prevented. 
[0012] 

[Embodiment of the Invention] Hereafteran embodiment of the invention is 
described based on a drawing. Drawing 1 is a control constitution figure of the 
drainage pipe cleaning-robots device in which an embodiment of the invention is 
shown. 

[0013]The drainage pipe cleaning-robots device comprises the drainage pipe 
cleaning robots 1 which clean the inside of a drainage pipe by repeating order 
**and its robot controller 2and it is connected by the cable 3 between the 
drainage pipe cleaning robots 1 and the robot controller 2. 
[0014]In said drainage pipe cleaning robots 1the motor 4 for robot advance (it 
abbreviates to an advance motor hereafter)The motor (it abbreviates to a 
sternway motor hereafter) 5 and the industrial camera 6 for robot sternway are 
installedand the motors 4 and 5 are driven by supplying electric power from the 
robot controller 2 via the cable 3and the video signal of the camera 6 is 
transmitted to the robot controller 2 via the cable 3. 

[0015]The robot controller 2 comprises the voice operation and the confirming 
device 7the distribution power board 8 and the controller 9 which are mentioned 
laterand the monitor 10 which displays the video signal of the camera 6. Said voice 
operation and confirming device 7 comprise the microphone 1 1 and the voice 
recognition part 12the interface part 13 and the voice database 14 which are 
mentioned laterthe speech synthesis section 15and the loudspeaker 16. 
[0016]The contents of operation recognize "advance"sternwayand a "stop" with 
the voice operation signal into which the above-mentioned voice recognition part 
12 was inputted from the microphone 1 1the recognition threshold — high — ( — 
H) — low — ( — whether it is larger than the preset value of the level which is 
two of L)[ judge and ] In below a low preset valuedo not output at allbut when 
larger than a low preset valueThe operator guidance signal of recognized 
"advance"sternwayor a "stop" is outputtedand it is larger than a low preset 
valueandin below a high-level preset valuethe display instruction signal of the 
"flicker" which shows that recognition is ambiguous is outputted. 
[0017]"Advance" to which the above-mentioned interface part 13 was outputted 
from the voice recognition part 120r corresponding to the operator guidance 
signal of "sternway" or a "stop" to the controller 9. The display instruction signal 
of the "flicker" which outputted the advance command signal which consists of 
pulse signalsthe sternway command signalor the stop command signaland was 
outputted from the voice recognition part 12 is outputted to the controller 9the 
operation impossible signal mentioned further later is inputted from the controller 
9and it outputs to the voice database 14. 

[0018]The above-mentioned voice database 14 memorizes the voice response 
data corresponding to the operation impossible signal inputted from the operator 
guidance signal and the interface part 13 of "advance" inputted from said voice 



recognition part 1 2or "sternway"chooses the voice response data corresponding 
to an input signaland outputs it to the speech synthesis section 1 5. 
[0019]The speech synthesis section 15 forms a voice synthesis signal based on 
the voice response data outputted from this voice database 14and outputs it to 
the loudspeaker 16and the loudspeaker 16 generates a sound with the voice 
synthesis signal outputted from the speech synthesis section 1 5. 
[0020]The push button switch 22 (an advance lamp and an advance switch are 
called hereafter) with lighting lamp 21 which becomes said distribution power board 
8 from the illumination switch for forward operationThe push button switch 24 (a 
sternway lamp and a sternway switch are called hereafter) with lighting lamp 23 
which consists of an illumination switch for reverse operationsand the reset switch 
25 are formed. 

[0021]The block diagram of drawing 2 explains the composition of said controller 9. 
RIREI F which operates with RIREI ST which operates with the stop command 
signal inputted from the interface part 13 of voice operation and the confirming 
device 7and a flicker command signal. The 1st pulse generation part 31 that 
changes the pulse signal of an advance command signal into the pulse signal 
extended to the width of predetermined timeThe 2nd pulse generation part 32 that 
changes the pulse signal of a sternway command signal into the pulse signal 
extended to the width of predetermined timeThe 1st motor driving section 33 that 
supplies electric power to the advance motor 4the 2nd motor driving section 34 
that supplies electric power to the sternway motor 5and the flicker actuators 35 
and 36 which output a flicker signal when an input signal is one (high-level) are 
formed. When the output pulse signal of the 1st pulse generation part 31 is 
outputted to the advance lamp 21the output pulse signal of the 2nd pulse 
generation part 32 is outputted to the sternway lamp 23 and this output pulse 
signal is one (high-level)When RIREI F is OFF (i.e.when the flicker actuators 35 
and 36 do not operate)a lamp is turned onand when RIREI F is one (i.e.when the 
flicker actuators 35 and 36 operate )the flicker of the lamp is carried out. 
[0022]And when the output pulse signal of the 1st pulse generation part 31 is one 
(highHevel)If the advance switch 22 is operatedit will be heldan advance driving 
signal will be formedthat signal will be inputted into the 1st motor driving section 
33and electric power will be supplied to it by the 1st motor driving section 33 
during one of this advance driving signal to the advance motor 4. The pulse signal 
outputted from the 1st pulse generation part 31 by an advance driving signal is 
turned offand the advance lamp 21 is switched off. If [ said advance driving signal ] 
RIREI ST serves as one (i.e.an input of a stop command signal will reset.) 
[0023]When the output pulse signal of the 2nd pulse generation part 32 is one 
(high-level)If the sternway switch 24 is operatedit will be helda sternway driving 
signal will be formedthat signal will be inputted into the 2nd motor driving section 
34and electric power will be supplied to it by the 2nd motor driving section 34 
during one of this sternway driving signal to the sternway motor 5. The pulse signal 
outputted from the 2nd pulse generation part 32 by a sternway driving signal is 
turned offand the sternway lamp 23 is switched off. If [ said sternway driving 



signal ] RIREI ST serves as one (i.e.an input of a stop command signal will reset.) 
[0024]When the output pulse signal of the 1st pulse generation part 31 is one 
(high-level)If the sternway switch 24 is operatedor if the advance switch 22 is 
operated when the output pulse signal of the 2nd pulse generation part 32 is one 
(high-level)an operation impossible signal will be formed and it will be outputted to 
a voice database via the interface part 13. The pulse signal outputted from the 1st 
pulse generation part 31 by this operation impossible signal and the pulse signal 
outputted from the 2nd pulse generation part 32 are turned offand the lamps 21 
and 23 are switched off. 

[0025]The pulse signal outputted from the 1st pulse generation part 31 by the 
operator command signal of the reset switch 25 and the pulse signal outputted 
from the 2nd pulse generation part 32 are turned offand the lamps 21 and 23 are 
switched off. 

[0026]Hereafterthe operation in the above-mentioned composition is explained 
according to the flow chart of drawing 3 . Since the same operation as the case of 
advance is performed in sternwaythe explanation is omitted. 
[0027]A worker utters operation of the robot 1 toward the microphone 1 1 . If the 
input of the audio signal of this utterance is checked from the microphone 11 
(Step Dthe voice recognition part 12The contents of operation are recognized 
with the inputted audio signal (Step 2)in below a low preset valuea recognition 
threshold and a low preset value are returned to Step 1 as compared with the 
next (Step 3)and when larger than a low preset valuea high-level preset value is 
compared (Step 4). In below a high-level preset valuethe display instruction signal 
of a "flicker" is outputted to the interface part 13 (Step 5)Thenwhen the contents 
of operation are "advance"the operator guidance signal of "advance" is outputted 
to the interface part 13 and the voice database 14andin a "stop"the operator 
guidance signal of a "stop" is outputted to the interface part 13 (Step 6). 
In "advance"although the voice database 14 progresses[ the voice response data 
corresponding to an operator guidance signalfor exampleahead / "// of 
"advance" ]isn't there any obstacle? " — although voice response data is 
chosenit outputs to the speech synthesis section 15 (Step 7) and he follows the 
speech synthesis section 15 ahead [ "] via the loudspeaker 16 according to this 
voice response dataisn't there any obstacle? " — it announces (Step 8). 
[0028]On the other handwhen a pulse advance command signal is formed 
according to the operator guidance signal of the above "advance" and the display 
instruction signal of a "flicker" is inputtedthe interface part 13 forms a flicker 
command signaland outputs it to the controller 9 (Step 9). 
[0029]If the controller 9 inputs this advance command signalthe pulse signal of 
predetermined time will be outputted to the advance lamp 21 by the 1st pulse 
generation part 31 If the flicker command signal is inputted at this time (Step 
10)the flicker of the advance lamp 21 will be carried out (Step 1 1)and if the flicker 
command signal is not inputtedthe advance lamp 21 will be turned on (Step 12). 
And in the 1st pulse generation part 31 the count of the predetermined time which 
considers the output pulse signal as one is started (Step 13). 



[0030]A worker checks the image sent from the camera 6 by the monitor 10 
according to said announcement and lighting of the advance lamp 21 and it 
confirms that there is no obstacle aheadand if satisfactorythe advance switch 22 
will be pushed. If an obstacle is ahead checked with the image of the monitor 
10nothing will be operated or the sternway switch 24 or the reset switch 25 will be 
pushed. 

[0031]If the input of the manipulate signal of the reset switch 25 is checked (Step 
14)the controller 9 will make the advance lamp 4 switch off (Step 15)and will be 
ended. When the input of the manipulate signal of the advance switch 22 is 
checked (Step 16)an advance driving signal is formedelectric power is supplied 
from the motor driving section 33 to the advance motor 4the robot 1 is advanced 
(Step 17)and the advance lamp 4 is made to switch off in Step 15. If the input of 
the manipulate signal of the sternway switch 24 is checked (Step 18)an operation 
impossible signal will be formed and it will output to the voice database 14 via the 
interface 13 of voice operation and the confirming device 7 (Step 19). 
[0032]The voice response data corresponding to this operation impossible signal in 
the voice database 14For examplechoose the voice response data of "being 
unable to operate it" and it outputs to the speech synthesis section 1 5 (Step 
20)The speech synthesis section 15 announces "it cannot be operated" via the 
loudspeaker 16 according to this voice response data (Step 21)and switches off 
the advance lamp 21 in Step 15. 

[0033]predetermined time — if operation of what is not carried outeitherthe 
advance command signal which became off [ the output pulse signal currently 
outputted from the 1st pulse generation part 31 ]namelywas inputted will be reset 
(Step 22)and the advance lamp 21 will be switched off in Step 15. 
In a "stop"the interface part 13 forms a stop command signal according to the 
operator guidance signal of a "stop"and outputs it to the controller 9 (Step 23). 
[0034]The controller 9 operates RIREI ST with this stop command signaland 
resets an advance driving signal (Step 24)the electric supply to the advance motor 
4 from the motor driving section 33 is stoppedand the robot 1 is stopped (Step 25). 
[0035]Againit returns to the state of the waiting for voice input. Thusif operation 
of "advance" of the robot 1 or "sternway" is utteredBy turning on the lamp 21 or 
23urging visual recognitionand operating the lamp 21 turned on as a resultthe 
switch 22 of 23or 24electric power is supplied to the advance motor 4 or the 
sternway motor 5 of the robot land the robot 1 moves forward or goes astern. 
Thereforetwo operations are performedand it can buy [ which operation has 
mistaken ] with checking the coincidenceit can be confirmed by it whether there is 
nothingas a resultthe drive of the robot 1 by an operation mistake can be 
preventedand the accident of the robot 1 colliding with the fall and the obstacle to 
the level difference of a drainage pipe by an operation mistake can be prevented. 
[0036]If operation of a "stop" of the robot 1 is utteredthe electric supply to the 
advance motor 4 or the sternway motor 5 of the robot 1 is stopped 
unconditionallyand the robot 1 can be suspended. 

[0037] When the speech recognition of utterance instructions is ambiguousthe 



flicker of the lamps 21 and 23 can be carried outthat utterance is insufficient can 
call the attention of especially the next operation by being displayedand an 
operation mistake can be prevented further. Instructions by utterance can be 
positively canceled by the reset switch 25. 
[0038] 

[Effect of the Invention]When the controls drive only when utterance and the 
manipulate signal of remote control are in agreement according to the invention 
according to claim 1as stated abovenamely2 stagewise operation is performedthe 
coincidence is checked and the controls drive after thatThe drive of the controls 
by an operation mistake can be prevented and the accident by the failure of the 
controls can be prevented. 

[0039]By checking whether the manipulate signal from the contents of operation 
and the control means of utterance of operation of the controls is in agreement 
according to the invention according to claim 2Buysthat operation is mistaken can 
check foras a resultthe drive of the controls by an operation mistake can be 
preventedand the accident by the failure of the controls can be prevented. 
[0040]Furthermoreaccording to the invention according to claim 3the voice data 
corresponding to the contents of operation of utterance of remote control is 
chosenFor examplewhen the announcement to which visual recognition is urged is 
performedand a control means is operated according to this 

announcementnamelyoperation which is the 2nd time is performedcoincidence with 
said contents of operation is checked and the controls drive after thatThe drive of 
the controls by an operation mistake can be prevented and the accident by the 
failure of the controls can be prevented. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a lineblock diagram of the remote control in which an embodiment 
of the invention is shown. 

[Drawing 2] It is a block diagram of the controller of the remote control. 
[Drawing 3] It is a flow chart explaining operation of the remote control. 
[Drawing 4] It is a flow chart explaining operation of the remote control. 
[Description of Notations] 

1 Robot (controls) 

2 Robot controller 

3 Cable 

4 Advance motor 

5 Sternway motor 

6 Industrial use camera 

7 Voice operation and a confirming device (voice operation and verifying means) 

8 Distribution power board 

9 Controller (control means) 



10 Monitor 

1 1 Microphone 

1 2 Voice recognition part 

1 3 Interface part 

1 4 Voice database 

1 5 Speech synthesis section 

16 Loudspeaker 

21 Advance lamp (displaying means) 

22 Advance switch (control means) 

23 Sternway lamp (displaying means) 

24 Sternway switch (control means) 

25 Reset switch 



